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' Abstract. A statistical mechanical framework to analyze linear vector channel 

models in digital wireless communication is proposed for a large system. The 
framework is a generalization of that proposed for code-division multiple- access systems 
in Europhys. Lett., 76 (2006) 1193 and enables the analysis of the system in which 
c/3 , the elements of the channel transfer matrix are statistically correlated with each other. 

^ ' The significance of the proposed scheme is demonstrated by assessing the performance 

of an existing model of multi-input multi-output communication systems. 

> 

^ ■ PACS numbers: 84.40.Ua, 75.10.Nr, 89. 70. -he 
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' 1. Introduction 

o 

l> . 

O ■ In recent years, the number of objects to which statistical mechanical analysis can be 
applied has increased rapidly. The digital wireless communication system is one such 
^ . example, and many intriguing studies in this field have revealed a strong relationship 
between telecommunication systems and statistical mechanics [HIS]- 

The linear vector channel is one of the basic categories of wireless communication 
system. Code division multiple access (CDMA) [3], which is employed in third- 
generation cellar phone systems and wireless LANs, is a type of linear vector channel. In 
the general CDMA scenario, many users transmit discrete symbols that are modulated 
by random signature sequences using a single channel, and mixtures of user signals and 
noises are received at the other end of the channel. This indicates that the problem 
of simultaneously demodulating user signals from received signals can be mapped to a 
virtual spin system governed by random interactions. This problem has been successfully 
solved by techniques developed in statistical mechanics for disordered systems, and in 
particular by the replica method [H [5l EJ [3, [8] . 

The multi-input multi-output (MIMO) system is another well-known example of 
a linear vector channel to which the statistical mechanical approach is applicable 
P, [ini [H]. A MIMO system is composed of many transmit and receive antennas. 
In a general scenario, multiple input signals transmitted from transmit antennas are 
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received at the receive antennas, being linearly transformed to multiple output signals 
by a channel transfer matrix. In several preceding studies, channel transfer matrices 
are regarded as deterministic. However, the elements of such matrices vary with time 
in actual cases, which implies that handling the matrices as random is more realistic. 
In the simplest model, each element of the matrix could be regarded as an independent 
Gaussian variable with zero mean. Unfortunately, modeling of this type is inadequate for 
describing realistic MIMO systems in which correlations among the matrix elements are, 
in general, not negligible due to spatial proximity among transmit or receive antennas. 
For continuous inputs that are modeled as Gaussian variables, simple expressions of 
performance evaluation can still be obtained by using knowledge of random matrix 
theory [12]. However, such expressions cannot be applied directly to discrete inputs, 
which are usually used in digital communication. Therefore, developing a framework to 
analyze MIMO systems, and, more generally, linear vector channels of discrete inputs 
are demanded. 

The purpose of the present article is to meet such a demand. Recently, the authors 
proposed a scheme to analyze CDMA systems under the assumption that a cross- 
correlation matrix of signature sequences can be regarded as a sample generated from 
a certain type of random matrix ensemble, which is characterized by an eigenvalue 
spectrum [13]. We herein generalize this scheme so as to be applicable to a wider class 
of linear vector channels. 

The present paper is organized as follows. In Section 2, the linear vector channel 
models investigated herein are introduced. Section 3, in which a framework to analyze 
a given system is developed based on the replica method, is the main part of this 
article. The assumption of uniformity of transmitted signals generally guarantees that 
the average of the replicated Boltzmann weight depends on replicated vectors only 
through overlaps among the replicated and original vectors. This makes it possible to 
evaluate typical properties of the target system using a single function, which is referred 
to as G{x) [m [15]. In general, the analysis of typical property requires assessment 
of quenched averages, which implies that G{x) should be evaluated as a quenched 
average utilizing the replica method. However, we will show that the assessment of 
this function can generally be reduced to the calculation of an annealed average due 
to a distinctive property underlying the evaluation of the average eigenvalue spectrum 
of the cross-correlation matrix for a given channel transfer matrix ensemble using the 
replica method if the eigenvalue spectrum of the ensemble is self-averaging. In Section 
4, the significance of the framework is demonstrated by application to one of the typical 
MIMO models called the Kronecker model. Finally, Section 5 presents a summary of 
the present study. 

2. Model definition 

A linear vector channel is defined as a system in which an input vector composed of K 
components, b = {pk) {k = 1,2, . . . , K) (boldface denotes vector or matrix), is linearly 
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transformed by an L x channel transfer matrix H and is additively degraded by noise. 
For generality and simplicity, we assume that H and b are defined over the complex 
number field, and the channel noise is given as circularly symmetric complex additive 
white Gaussian noise, the variance of which is Nq. We denote Re(M) and Im('u) as 
real and complex parts of a complex number u, respectively. |m| = A/Re(M)^ + Im(u)^ 
denotes the absolute value of u. Under these assumptions and notations, the output 
vector 

r = Hb'+ v^r7, (1) 

is received by a receiver, where 6" denotes the input vector that is actually transmitted, 
and the components of the noise vector t], rji (/ = 1,2,...,L), independently 
obey circularly symmetric complex normal distributions P{ri) = vr"^ exp [— |?7p] = 
TT"^ exp [-{Re{r]f + lm{r]f)]. 

In the performance analysis shown below, H is regarded as a sample from a certain 
random matrix ensemble, typical samples of which are dense. Namely, we assume that 
most elements of typical H do not vanish. Since an elegant framework has been already 
established for Gaussian inputs [12] , we focus on cases of discrete inputs in which input 
symbols are expressed as bk G {e^'^*^/'^|s = 0, 1, 2, . . . , 5* — 1} = As, where i = y/^-T. 
This expression corresponds to standard digital communication schemes of binary phase 
shift-keying (BPSK) and quadratic phase shift-keying (QPSK) for S = 2 and 3 = 4, 
respectively. We further assume that b is encoded so as to be uniformly generated as 
P{b) = 1/5^^ for optimizing communication performance. 

After receiving r the remaining task for the receiver is to infer the original vector 6°. 
The optimal inference scheme to minimize the component-wise probability of incorrect 
estimation, which is referred to as Pb, is constructed from the posterior distribution 

1 



P{b\r) = Z-^exp 



Hb\ 



(2) 



as bk = argmaXf,^ |S6\bfe hope that a model parameter of noise variance 

Nr is in agreement with the correct value Nq. Here, 



Z = ^ exp 



(3) 



serves as the partition function, and b^ denotes the estimate of b^, where Ag denotes 
the fc-th extension of symbol set As. 



3. Analytical scheme 

3.1. Gauge transformation and Haar measure 

Since the posterior distribution ([2]) depends on predetermined random variables H, 6°, 
and 77, we resort to the replica method for assessing typical property of the linear vector 
channel. Thus, we first substitute equation ([T]) into equation ([3]) and perform gauge 



Statistical mechanical analysis of the linear vector channel in digital communication 4 



transformation {b^ybl {k = 1,2, . . . , K; a = 1,2, ... ,n), where * denotes the 

complex conjugate. This yields an expression of the replicate partition function ([3]) for 



n 



1,2, 



as 



E 



exp 



1 " 

— 5^|f/diag(6°)(l-r") 



a=l 



(4) 



where 1 is a fT- dimensional vector, all elements of which are unity and r" = (r^) 
{k = 1,2, . . . , K; a = 1,2, . . . ,n). The diagonal matrix diag(6°) is defined as diag(b°) = 
(Skjb^). Next, we average this expression with respect to 6° over the correct prior 
P(6°) = fixing gauged vectors {r"} = {r^, r^, . . . , r"}. Here, we consider a 

property whereby vectors diag(6°)(l — t"") {a = 1,2, ... ,n) are sampled isotropically in 
/T- dimensional vector space under constraints of relative configuration 



(l-T'^)-(l-T' 

for a 7^ 6(= 1,2, ... ,n), and 

(l-T'^)-(l-T 

for a 



1,2, ...,n. 



T^j . ^1 - T^j = {b' - b'^) . {b' - b') = 2K{1 - ma), (6) 

where ■ is defined as x ■ y = J2k=i ^IVk ^^i complex vectors 
X = (xfc) and y = (yk) {k = 1,2,...,K). rua = {1/K)1 ■ = {1/K)b" ■ b" 
and Qab = {1/K)t'' ■ = {1/K)b'' ■ b^ = g*^ (a, 6 = 1,2,..., n). This implies 
that for any fixed set of {r"}, the average of the replicated Boltzmann weight 
exp [—l/{Nr) Yla=i \Hdiag{b°){l — t"-) + -\/iVo?7p] with respect to 6° is assessed as 



1 



exp 



n 

-5^|//diag(6°)(l-0 + 



Nr 



^Nor]\ 



a=l 



VU exp 



1 



a=l 



(7) 



where T>U denotes the Haar measure of unitary matrix U, which is normalized as 
JVU = 1. 

Equation (JTj) is justified by the following arguments. For a fixed typical pair 
of {r"} and H, which is dense, components of -ffdiag(6°)(l — r"), denoted as 
ti = Y.k,j Hikbk^kjil - Tj) = Y^k^ikbli^ - Tfc), are composed of many independent 
random variables and, therefore, can be dealt with as complex Gaussian variables 
as a consequence of the central limit theorem when b^ is sampled from the uniform 
distribution P(b°) = 1/S^. This means that statistical properties of tf are fully 
characterized by only the first and second moments, which are determined by 
those of matrix components of diag(6°). More precisely, the relevant moments are 
evaluated as [tfy = and myt'J.o = E.nHlkHmn[{bim]A^ - r^Ti^ ' <) 



^k,n HikHjnn^kn[ 



K'^^I — t") ■ (1 — r'') for /, m = 1,2, ... ,L and a,b = 1,2, . . . ,n, where [■ ■ -j^o represents 
average with respect to -P(6°) = 1/S^ . The final replacement for the second moments 
[(t")*t^]bO is allowed as H and {r"} are statistically uncorrected a priori. Here, 
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it is noteworthy that the identical moments are reproduced by substituting unitary 
matrix U for diag(b°) in conjunction with replacement of the Haar measure VU with 
P(6°) = This validates equation (JTj), which will be supported by numerical 

experiments shown later herein as well. 



3.2. G -functions and free energy 



Next, averaging with respect to rj, we obtain 



1 " 

-El«C/(l-r») + 



a=l 



/ —r exp \ — \r]\ X exp 

= exp [TrRL^n)] , 
where dr] = Uti dRe{r]i) dlm{r]i), R = U\H^ H)U and 



(8) 



Lin) 



n 



t'){1 



.a^t 



+ 



a=l 
iVr 









^ ' \a=l 

where J.^ denotes integration over a certain support set X. Next, integrating equation 
([8]) over the Haar measure T>U in conjunction with taking average with respect to H 
yields an expression of the averaged Boltzmann factor: 



exp 



--^X^|f/diag(b°)(l 

VUexp [TTRL{n)] 
Lin 



'Noii\ 



J H 



exp 



H 



K 



exp 



H 



G 



H 



K 



H 



exp 



KTiG 



Lin) 
K 



(10) 
(11) 



for large where and [■ ■ ■] jif denote the averages with respect to 6°, 77, and H and to 
only i3", respectively. Transformation of equation (fTOj) is valid if the eigenvalue spectrum 
of H is self-averaging, i.e.., if the discrepancy between the eigenvalue spectrum of 
typical samples of H and its average vanishes as K, L ^ 00 with keeping the load 
/3 = K/L finite, as assumed hereinafter. A practical method to evaluate functions 
Gh{x) and G{x) and the validation of equation ( |TOl) are discussed later herein. 

Intrinsic permutation symmetry among replicas naturally leads to the replica 
symmetric (RS) ansatz. This implies that configurations characterized by 1 ■ r" = 
. If = Km (a = 1, 2, . . . , ra) and t'' ■ = If ■ = Kq {a ^ h) provide the most 
dominant contribution to the evaluation of Z". Note that the RS ansatz requires obvious 



symmetry 



r", which enforces qab = Qba = Q to be real at the saddle point 



for Va, b = 1,2, ... ,n. Under this ansatz, the K x K matrix L{n) has three types of 
eigenvalues: Ai = -K{Nr + nNo)~^{l - q + n{l - 2m + q)), X2 = ~KN-^{1 - q) and 
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A3 = 0, the numbers of degeneracy of which are 1, n — 1, and K — n, respectively. This 
indicates that equation ffTTl) is evaluated as 



In addition, the RS ansatz offers the number of microscopic configurations that satisfy 
constraints ([5]) and as 

n 

Tr^ n ■ "^^ ~ n ^^'^'^ ' '^^ ~ - [^Sn{q, m)] , (13) 

where 



a=l 



a>b 



Sn{q,m) 



Extr 

q,rh 



In 




nmm 



n[n 



-qq 



(14) 



where Extru{- ■ ■} indicates the extremization of {■ ■ •} with respect to u and DC, = 
((iRe(C)rfIm(C)/27r) exp [— |^p/2] denotes the complex Gaussian measure, the variance of 
which is normalized to unity in each direction of the real and complex axes. Analytically 
continuing equations (fT2|) and (fT3l) from n G N to n G M yields an expression for assessing 
the configurational average of free energy as 



= Extr 

m,q,rh,q 



-mm 



lim — - 

n^O uK 



G 
q{l 



In 

1-q 



l-2m + q Noil-q) 



+ / DC\Ti 



Nr. 

H exp 



iV2 
r 



G' - 




The saddle-point solution yields the bit error rate for the demodulation strategy = 
argmaxfc^ {Y.b\bt, ^(^l'^)} as Pb = £'C0error(C; ^, '^), where eerror(C; ^, vanishes if 
exp [Re {{y/qC* + '^)t)] is maximized by r = 1 among r G As, and unity, otherwise. 

Note that both the RS assessment presented here and that of the replica symmetry 
breaking (RSB) ansatz are generally possible following the current framework. For 
instance, as shown in Appendix A, one can evaluate the free energy under the ansatz of 
one step replica symmetry breaking (IRSB) by dividing n replicated vectors {t"} into 
n/x groups of identical size x and assuming that the correct saddle point is characterized 
by the following relative configuration: ■ r'' = K, K{q + A), and Kq for a = b, for the 
case in which a b but a and b belong to an identical group and otherwise, respectively. 
In the limit n ^ 0, the IRSB saddle-point equation is obtained as 



m = ^^DC 



(16) 
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Here, G[ = 



G"(-(l - q + {x - 1)A)/Ar, 
= G"(-(l - q - A)/iV,), A = 



G'[ = G"(-(l - q + {x - 
;i _ 2m + q)/Nr + {No/N^){l - 



q + 



[X 



1)A), S = Ere^ exp Re UV Ai]* + + m)r) , and (r), 



e^^rexp 
For X 



Re (^(V A?7* + y/qC* + mjr ^ 
1, a useful relation 
^Dr7H(r), _ E.e^,^exp [Re ((V^C + m)r)] 



(17) 



implies that the saddle-point condition of equation f|T6l) is governed by only four out 
of six variables, i.e., q,rh,q and m. Actually, the condition for determining the four 
variables in this case corresponds to the saddle-point equation of RS free energy (flSll . 
which implies that x — 1 RSB analysis is generally reduced to that of RS. Nevertheless, 
a nontrivial result can still be obtained by investigating the behaviors of A and A, 
which are subserviently determined from equation f|T6l) . This equation guarantees that 
A = A = always satisfies the saddle-point condition. However, for a; — 1 stability 
analysis indicates that a nontrivial solution of A > and A > emerges if 



:G" 



which is in accordance with the de Almeida-Thouless (AT) condition signaling the local 
instability of the RS solution [16] . 



3.3. 



Equivalence between quenched and annealed averages in the assessment of G{x) 



Gh{x) can be assessed by several formulae [171 [ISl [IH]- One formula uses the Stieltjes 
(or Cauchy) transformation of Pff(A) = (l/K) EfcLi ^(-^ ~ -^fc), which is the eigenvalue 
spectrum of cross-correlation matrix H, 

dXpniX) 



where Ai, A2, . . . , A;^ are eigenvalues of H^H and are guaranteed to be real because 
H^H is Hermitian. For given x, this relationship determines A(x) implicitly, which is 
termed the Stieltjes inversion formula. Using A(a;), G'ff(x) is assessed as 



Gnix) 



dt (A(t) - 1-^) 



(20) 



which is equivalent to the ^^-transformation known in free probability theory [201 |2T] . 

Here, we describe a rather primitive approach. For this objective, we substitute 
xee^ for L{n) in equation ([8]), where e is a certain complex vector, the length of which 
is fixed as |ep = K. Note that the eigenvalues of this operator are Kx and zero, the 
degeneracies of which are 1 and K — 1, respectively. Integrating over T>U yields the 
following expression: 



exp [KGh{x)] = exp 



KTtG 



H 



xee 



xee' 



Statistical mechanical analysis of the linear vector channel in digital communication 8 

^ IcK du6{\u\^ - Kx) exp [u'^{H^H)u\ ^^^^ 
J^K du6{\u\'^ — Kx) ' 

where we set u = ^Ue. Inserting b{\u\^ — Kx) = J^^^ dAexp [— A(|wp — Kx)] /(27ri) 
and employing the saddle-point method with respect to the integration of A yields the 
following expression: 

Gh{x) = Extr |--^lndet \A-H^H\ + Axj -Inx - 1, 

= Extr < -— In |A - Afcl + Ax I 
M ^tl J 

= Extr (iApf/(A)ln|A - A| + Axj -Inx- 1. 

In conjunction with equation (fTTl) . this indicates that G{x) is offered as 



Inx 



G{x) 



Extr 

A 



I-/ 



d\p{\) In |A - A| + Ax ^ - Inx - 1 



(22) 

(23) 
p(A) as 



using average spectrum p(A) = [pj/(A)]jj if a self-averaging property Pi/(A) 
K,L ^ oo {P = K/L ~ 0(1)) holds for typical samples of H. 

p(A) can be formally assessed as follows ^22j. For this, we introduce a partition 
function of complex Gaussian spins as 

= 71^ [det(A/i^ - H^H)] , (24) 

where u is a i^-dimensional complex vector and Ik denotes a K x K identity matrix. 
The dispersion formula 



5(A- A) 



lim — Im 



A- A 



indicates that p(A) can be assessed as 



P(A) 



-Im 



TC 



dAK 



[inZ^^^^^(A)] 



H 



-^I-(I^MA-A)), (25) 



(26) 



where K~^ [in Z^^^'^'^(A)] can be evaluated by the replica method. 

For this evaluation, we assess the moments of Z'^'^^^{X) for n E N with use of the 
saddle-point method, assuming that the saddle point is characterized by the Hermitian 



matrix Q 
expression: 



ab 



{K-^u'' 



■ U" 



fa, h 



1,2, 



.n] 



This yields the following 



lln[(Z^— (A))^ 



H 



Extr 

Q,Q 



1 



In 



Wdu" 



exp 



a=l 



n 

5^(li'^)t ((A - Qaa)lK - H^H) 



a=l 



TrQQ 



(27) 



H 
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where Q = (Qab) denotes the conjugate matrix of Q (Hermitian: does not indicate 
the Hermitian conjugate of Q) to perform the saddle-point assessment. A distinctive 
property of equation ( 1271) is that Q = always satisfies the saddle-point condition for 
Vn G N. This means that 

-L In [(Zr-(A))"] ^ = ^ [- In det {Mk - H^H)]^ + In vr 

= -iln[Z^— (A)]^, (28) 

generally holds for the partition function and Vn G N. Extending this expression 
analytically from n G N to G M and taking n yield a formula by which to 
evaluate p(A) using the annealed average of the partition function as 



p(A) = -Im 

TT 



(29) 



OAK 

Let us insert this expression to equation fl23l) and perform partial integral. This 
operation and the dispersion formula fl2^ yield another expression of G{x) as follows: 

G{x) =Extr|-^ln [Zg^^^^(A)] ^ + Aa; - In vrj -lna;-l 

Extrl^^ln [ ^ lexr, \ -uU AI K - H^H)u\]^ + Ax\ -lux - 1 
A [K JcKir^^ ^ ^ ' J 

7cx du5{\u\'^ - Kx) exp [u^{WH)u] 



f^if duSdul"^ — Kx) 



J H 



^ln[exp[KGHix)]]H. (30) 



Equations (ITTI) . (1221) . and (l30l) indicate that equivalence between annealed and quenched 
averages holds in the assessment of G{x), which validates replacement in equation ffTOj) . 

The current argument may be useful in assessing the typical performance of 
an ensemble of channels. Equations flTIJl) and fl2Ul) can be used for evaluating the 
performance of a single sample of H or for evaluating the performance of a channel 
ensemble, in which the eigenvalue spectrum is fixed [131 EI]- However, naive extension 
to the analysis of the typical performance of a channel ensemble along this direction 
generally requires taking configurational averages with respect to a certain distribution 
of H after evaluating the sample-by-sample performance of H using equations (fT9l) and 
(!20|) . From a practical viewpoint, this is not possible. However, equation (130|) indicates 
that the typical performance of a channel ensemble can be evaluated using a single 
function G{x) that characterizes the ensemble property if the eigenvalue spectra are 
self- averaging. This function can be assessed by the calculation of an annealed average, 
which, practically speaking, is in most cases much simpler than the calculation of the 
quenched averages. Formula (j29l) is useful as well because this equation can be used to 
numerically evaluate p(A) for a certain class of ensemble, for which analytical evaluation 
of p(A) is difficult. This is demonstrated in the next section. 
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4. Application 

4.I. Kronecker model 

Let us demonstrate the significance of tlie proposed framework by analyzing a certain 
channel ensemble. The ensemble that we focus on is termed the Kronecker model, which 
is a standard MIMO model [T2|[23l[2l]. 

In this model, the channel transfer matrix H is represented as 

// = R,f.Z \/ Rf, (31) 

where Z = {zik) is an L x random matrix, each component of which is independently 
sampled from an identical circularly symmetric complex Gaussian distribution P{z) = 
Lvr^^exp [— L|zp]. Here, Rr is an L x L Hermitian matrix that represents the effect 
of spatial correlation among receivers and antennas. The K x K Hermitian matrix Rt 
represents similar effects for transmit antennas. We assume that eigenvalue spectra of 
Rr and Rt are given as Pr{X) and Pt(A), respectively. 



4-2. Average eigenvalue spectrum 

For analyzing the typical property, we first introduce an expression of partition function 
of the complex Gaussian spins 

/ duexp [-u\AIk - WH)u] 
-A.\u\^ + {Z^/Rtu)^Rr{Z^/RtU 



7Gauss 



(A) 
c?ti exp 



(32) 



Note that for fixed u in the integrand of equation (132|) Z^/RtU = v = {vi){l = 
1, 2, . . . , L) can be handled as a circularly symmetric zero- mean L-dimensional complex 
Gaussian random vector that is characterized by covariance [vlvj]^ = L~^u^ Rtu5ij = 
I3u^ Rtu5ij {l,j = 1,2,...,L) when each component of Z in equation ( 1311) is 
independently sampled from the identical distribution P{z) = Lvr"^ exp [— L|zp]. 
Taking this property into consideration, we evaluate the annealed average of equation 
([32]) as 

^^Gauss^^^j ^ = /" d{KQ)d{Kl3T) [ du5i\u\^ - KQ)Siu^RtU - KjST) 



X exp [— A|it|^] X / 
d{KQ)d{K(3T) 



dv 



CL [TTf3T) 

dQ df 



N 



exp 



\v\ 



+ v'^RrV 



X exp 
d{KQ)d{K(3T) 



(3T 

duexp -u\{A + Q)Ik -fRt)u 

K{QQ - TT) X [det(/L - pTRr)]''^ 
dQ df 



2'Ki 2'Ki 



27ri 2'Ki 



exp 



K{QQ - TT) 



X vr 



K 



-1 



det((A + Q)Il- TRt) X [det(/L - jSTRr)]'^ . (33) 
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Utilizing the relations ir-Mndet((A + Q)Ik - TRt) = J dXpt{X)\n{A + Q - fX) 
and L"^lndet(/L — (3TRr) = J dXpr{X) ln(l — /3TA), this equation indicates that the 
annealed average of the partition function is evaluated by the saddle-point method as 

lln [Z^— (A)]^ 



K 

Q,Q,T,T 



Extr \\n7T + QQ -TT 

)OfT < 

j dXpt{X) ln(A + Q-fX)-^j dXpriX) ln(l - /?TA)| . (34) 



This yields the following equations: 

which are only relevant for the saddle-point condition because Q = always holds. The 
solution of equations (!35l) and (!36l) yields the average eigenvalue spectrum as 

p(A) = -lm{Q) = -Im { / dX-^^] . (37) 



4-3. Performance assessment for correlation matrices of Tdplitz type 

We applied the proposed scheme to the case in which both correlation matrices Rr and 

Rt are of the Toplitz type, in which the {i,j) elements of Rr and Rt are given as r'*"-^' 

and t'*"-'!, respectively, where < r < 1 and < t < 1. For matrices of this type, 

eigenvalue spectra can be computed analytically in the limit of i^, L ^ oo as 

1 1 ± r 

Pr(A) = ^ , , a± = J—, (38) 

7rAA/(a+ - A)(A - a_) 1 =F ''^ 

and similarly for pt{X). For the purpose of illustrating generality, we employed numerical 
methods based on equations fl23l) and fl29l) to analyze this model, although expression 
( 138|) potentiates further analytical treatment, which will be reported elsewhere [25]. 

Figure [1] shows a comparison between the numerical average of the eigenvalue 
spectrum estimated from 200 samples of a 500 x 750 random channel transfer matrix 
(markers) and the theoretical prediction calculated from equation fl371) by numerically 
solving equations fl35|) and fl36l) (curve). The excellent agreement between the 
experimental and theoretical data in this figure indicates that our approach to the 
assessment of the average eigenvalue spectrum based on the numerical saddle-point 
analysis of the annealed average of a partition function works rather efficiently in this 
case. 

Figures [2](a) and EJ^b) represent the communication performance assessed by the 
current framework. For convenience, the data in these figures are computed for S = 2 
(BPSK) and real channels in which all elements of H and channel noises are restricted 
to real numbers by replacing complex normal distribution P{u) = tt"^ exp [— 
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Figure 1. Eigenvalue spectrum of channel transfer cross-correlation matrix H' H. 
The comparison of the analytical result obtained by the scheme demonstrated in 
Section 4 (curve) and the result obtained by numerical diagonalization of randomly- 
generated cross-correlation matrix (markers) is depicted. Here, each parameter is set 
as r = i = 0.2, j3 = 1.5, and 200 samples of a 500 x 750 random channel transfer matrix 
are used for numerical diagonalization. The results show good agreement. 

and unitary matrix U with real normal distribution P{x) = (27r)^^/^exp [— and 
orthogonal matrix O in computing G{x). Even if such a restriction is imposed, the 
framework is completely parallel. The only difference is that prefactor 1/2 is placed 
in front of the definitions of Gh{x) and G{x). The curves are provided by the 
saddle-point condition of equation ( |T5l) . numerically assessing G{x) from p(A) using 
equation (!23|) . while the experimental results denoted by markers were obtained by the 
Thouless- Anderson-Palmer equation of the proposed system based on a strategy similar 
to equation (12) of ref. [13j. The reasonably good consistency between the curves 
and markers indicates the significance of the proposed framework in the performance 
assessment of linear vector channels of discrete inputs. 

5. Summary 

In summary, we have developed a framework by which to analyze linear vector channels 
of discrete inputs based on the replica method. Assuming uniformity of the prior 
probability of inputs makes it possible to characterize the typical property of the 
objective channel ensemble by a single function G{x) if the eigenvalue spectrum of 
the cross-correlation matrix of the channel transfer matrix is self-averaging. We have 
also presented a practical scheme by which to evaluate G{x) and an average eigenvalue 
spectrum p(A) using an annealed average of a partition function of Gaussian spins. 
The significance of the proposed scheme is demonstrated by application to an existing 
channel ensemble called the Kronecker model. 

Future studies will include the mathematical validation of equation ([71) and the 
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P = K/L E,/No [dB] 

Figure 2. (a): Bit error rate Pf, vs. the ratio (3 = K/L under the condition 
No ~ Nr — 0.37, L — 1024, and a 500 sample average. The solid/broken hnes 
indicate the theoretical prediction obtained by the proposed scheme for the cases of 
r — t ^ 0.2/ r ~ t — (uncorrelated) , respectively. The bars indicate the result of 
the numerical experiment in the case of r = t = 0.2, which shows good agreement 
with the prediction, except for the region in the vicinity of the waterfall (first-order 
phase transition) point, (b): Bit error rate Pj, vs. signal-to-noise ratio Eb/No under 
the condition of /3 = 1.1, r = t = 0.2, L = 1024, and a 500 sample average. The 
bars, which express the numerical results, show good agreement with the theoretical 
prediction (solid) . The broken line indicates the analytical results for the uncorrelated 
case. 

development of a practical demodulation algorithm p6l [27]. 
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Appendix A. Free energy under IRSB ansatz 

Under the one-step replica symmetry (IRSB) ansatz, n replicated replicas r^, r^, . . . , 
are divided into n/x groups of identical size x, and the relevant saddle point is 
characterized by relative configuration 

{K, a = b, 

K{q + A), a and h belong to an identical group, (A.l) 
i^g, otherwise, 

and 1 ■ t"" = m {a,b = 1,2, ... ,n), where q. A, and m are assumed to be real to satisfy 
obvious symmetry r° ■ = ■ t"". Here, x serves as Parisi's replica symmetry breaking 
parameter after analytical continuation. For {t°} that satisfies this configuration, L{n) 
has four types of eigenvalues: Ai = —K{Nr + nNQ)'~^{l — q + {x — 1)A -|-n(l — 2m -|- q)). 
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A2 = ~KN-\1 -q+{x- 1)A), A3 = -KN;:\1 - g - A) and A4 = 0, the degeneracies 
of which are 1, n/x — 1, n — n/x, and K — n, respectively. This provides the following 
expression: 

'L(n) 



TrG 

= nG 
+ G 



K 

1 -g- A 



-\G 

X 



l-q + {x- 1)A 



Nr J X \ \ N, 
l-q + {x- 1)A + n(l - 2m + g) 



G 



Nr + uNo 



G 



1 - g - A 
1 - g + (x - 1)A 



(A.2) 



Using the saddle-point method, the number of microscopic configurations that satisfy 
the current ansatz increases as exp [KS^^^{q, A, m; x)] , where 

5fS^(g,A,m;x) 



Extr < In 

q,A,rh 



DC[ I D7][ Tr exp Re ( (V Ar^* + ^/qC + rh)T 



n 



— nmm — — (g + A) 
-- 2 (^^ + A)(g + A) - ggj - ^ ^ ^ gg 



(A.3) 



Equations ( 1A.2I) and ( 1A.3I) indicates that under the IRSB ansatz, free energy is assessed 
as 
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— In Z = lim In 
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